The Reserve Bank of India (RBI) on Thursday said that banks will have to provide premature withdrawal facility on all fixed deposits up to Rs 1 crore.